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Abstract. In Q], we introduced the weakly synchronizing languages 
for probabilistic automata. In this report, we show that the emptiness 
problem of weakly synchronizing languages for probabilistic automata is 
undecidable. This implies that the decidability result of |1I2I3] for the 
emptiness problem of weakly synchronizing language is incorrect. 



1 Definitions. 

We present the main notations and definitions. We refer to [1] for detailed pre- 
liminaries. 

A probability distribution over a finite set S is a function d : S — >• [0, 1] such 
that XLeS^( s ) = 1- T nc support of d is the set Supp(d) = {,s £ S | d(s) > 0}. 
We denote by T>(S) the set of all probability distributions over S. Given a finite 
alphabet E, we denote by E* the set of all finite words and by E u the set of all 
infinite words over E. The length of a finite word w is denoted by \w\. 

Probabilistic Automata. A probabilistic automaton (PA) A = (Q, fXo, E, S) 
consists of a finite set Q of states, an initial probability distribution /xo 6 T>(Q), 
a finite alphabet £, and a probabilistic transition function 8 : Q x S — > T>{Q). 
In a state q £ Q, the probability to go to a state q' £ Q after reading a letter 
a £ £ is S(q,a)(q'). We define Post^(<7, a) = Supp(<5(g, a)), and for sets s C Q 
and £' C E, let Post^(s, E') = [J qes U<tg^' P ost -4( ( Z: f7 )- The outcome of A on 
an infinite word w = o~qo~i ■ • ■ is the infinite sequence Aq A™ ... of probability 
distributions Af £ V{Q) such that Aq = fio is the initial distribution, and for 
all n > and q £ Q, 

^(?) = E g ' eQ ^-i(9 / )-%'^n-i)(9) 
The norm of a probability distribution X over Q is ||A|| = max,j g Q X(q). 
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Weakly Synchronizing Language for PAs. An infinite word w is said to be 
weakly synchronizing for PA A, if 

limsup \\A% || = 1. 

We denote by the set of all weakly synchronizing words, named weakly 

synchronizing language, of A. Given a PA A, the emptiness problem of weakly 
synchronizing language asks whether Cw(A) = 0. 

2 The emptiness problem of weakly synchronizing 
languages for PAs is undecidable. 

Theorem|2]states that the emptiness problem of weakly synchronizing languages 
for PAs is undecidable. To show that, we present a reduction from the value 1 
problem for PAs which is undecidable [1], to our problem. 

The value 1 problem for PAs. Let A = (Q, [to, £, 5) be a PA with a 
single initial state qo where noilo) = 1 an d a set of accepting states F C Q. 
The value 1 problem considers finite words: the computation of A on the word 
w = (Tq(Ji ■ ■ ■ <7„_i is the sequence AqA\" ■ ■ ■ A™ where Aq = no and A!f +1 (q) = 
12q>£Q A™ (q^S^q' , o~i)(q) f° r all < i < n. The acceptance probability of w by 
A is given by Pa{w) = Y^qeF •^■nil)- The value of A, denoted val(A), is the 
suprcmum acceptance probability val(A) — swp weS * P_^(w). Given a PA A, the 
value 1 problem asks whether val(A) = 1. It is equivalent to check if there are 
some words accepted by A with probability arbitrarily close to 1. 

Theorem 1. The value 1 problem for probabilistic automata is undecidable J^j. 
Undecidability result. 

Theorem 2. The emptiness problem of weakly synchronizing languages for 
probabilistic automata is undecidable. 

Proof. We present a proof using a reduction from the value 1 problem for PAs. 
Given a PA B = (Qb, (a*o)bj ^B, $b) equipped with the single initial state qo and 
accepting states Fb Q Qb, we construct another PA C = (Qc, (^o)c,^c, <5e)j such 
that val(B) = 1 iff C W (C) ^ 0. 

First, from the PA B we construct another PA A = (Q, £,S) such that 
B has value 1 iff A does. The state space is extended, by adding two new states 
q } and q n (Q = Qb U {q } , q n }). The alphabet £ = £ B U {$} where $ g £ B . The 
initial state qo is in common, but only qf is an accepting state (F — {<?/}). The 
transition function globally remains unchanged; only the following transitions 
are added in A: S(q,$)(qf) = 1 for all q £ Fx, and S(q, $)(q n ) = 1 for all 
q e Qb \Fl- In addition, S(q f ,a)(q n ) = S(q n ,a)(q n ) = 1 for all a £ E. Fig. [1] 
illustrates the definition of A from B. By construction, since qf is the only 
accepting state and is only reachable with $, and Post^({g/, q n }, E) = {<?„}. We 
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PA A 




Fig. 1. The definition of the PA A Fig. 2. Transitions between twin states 
from B. and 92,92- 



see that Pa{w) = Pb{v) if w = v% with v £ Eg, otherwise Pa{w) = 0. Thus, A 
has value 1 iff B has value 1. 

Then from the PA A, we construct a PA C = (Qc, (mo)c, Sc,Sc) such that 
Cw(C), the weakly synchronizing language of C is not empty, iff A has value 1. 
For each state q £ Q except qj, a twin state q is added to the state space. Thus, 
<3c=QU{q|qeQ \ {<?/}}. The alphabet E c = E U {#} where # ^ Z. The 
initial distribution is (^o)c('Zo) = (mo)c(<?o) — h- The probabilistic transitions 
function is defined as follows. 

- S c (qi,(j)(q2) = 5c (31,0") (&) = <5c(9i,cr)(q 2 ) = <5e(9i, c)(«2) = \ S{qi,a)(q 2 ) 
for all states qi,q 2 £ Q\ {?/} and all cr G E. 

- S c (q,cr)(q f ) = S c (q,a)(q f ) = S(q,a)(q f ) for all states q £ Q \ {q f }. 

- S c (qf,a)(q 1 ) = S c (qf,cr){qi) = \ %/ , a) (q x ) for all states q£Q\ {q f } and 
all a £ E. 

- In addition, S c (q, #)(?o) = S c (q, #)(<?o) = \ for all q £ Qc- 

Fig. E] shows the construction. For convenience, a twin g and q are drawn in 
an oval; Fig. [2] illustrates the transitions between two pairs of twin states where 
each pair is replaced with an oval. Intuitively, the PA C mimics the behavior of 
A where each state q (except the accepting state qf) shares the probability to 
be in q with the twin q, in all steps n £ N. Moreover, each # "resets" C. 

Let us shortly formalize two important and intuitive properties of C resulting 
from the construction. 

Property P±: Let w £ Eg be an infinite word containing the symbol # such that 
w = vi#v 2 where v\ £ Eq and v 2 £ Eg. Let CqC™ ■ ■ • be the outcome of C on 
the word w; and C^C^ 2 • • • be the outcome on v 2 . Since Postc(Qc, #) = {qo, qo} 
with uniform distribution, on inputting the letter the automaton C is reset 
to the initial distribution (^o)c, and one may "forget" the prefix t>i#. Formally, 
for alH £ N and q £ Qc, 

Cl" Vil+1+l (q)=Cr-(q). 
Property P 2 : For all words w £ Eg, the computations of A and C on w give 
a) C^(q) = C^(q) = \A^{q) for all q £ Q \ {q f }, 



3 



b) C^|(?/)=^,|(«/) = - 

Let us recall that $, # ^ Zg. Property P 2 -& can easily be proved since 
A*o(<Z/) = (a*o)c(9/) = and no cr— labeled transition with er G reaches 
c//. We prove Property P 2 .a by induction on the length of w. 

Base (|u;| = 0): Let w be the empty word e. By construction, we know the 
initial distribution for A is Ho(qo) = 1 and for C is (/io)c(c/o) = (Mo)e(<7o) = h- 

Induction: Assume that the statement holds for all words w' with w' < i. 
Let w = w'a where w' £ and cr E Eg. By definition, Cf (qi) = 

HqeQc ' 6 c{l-,o)(qi) for c/i £ Q \ {c//}. By induction hypothesis, since 

Qi'ife) = C^ x (g 2 ) for c/2 e Q \ {?/}, and since J c (q 2 , <r)(<li) = $c(Q2,o-)(qi), 
we conclude Cffa) = 2 E 92eQ C^ife) • 5 c (q 2 , a){ qi ) = 2 £ 92eQ (| ^f-ife)) • 
(i% 2! cr)( 9 i)) = |E, 2£Q ^-i(?2) •*((&, <^)(gi) = Similarly, we ob- 

tain Cf (ft) = \Af (q,). 

Now, we show that Cw(C) 7^ iff the PA A has value 1. 

<= First, we assume that A has value 1. So, for all e > 0, there exists a finite 
word w £ S* such that Pa{w) > 1 — e. Let Wi be such that PA( w i) > 1 — 2 _l 
for all i > 1. We claim that the infinite word v = (wi#)ieN = uu#w 2 #W3# • • • 
is a weakly synchronizing word for C. Let CqCJ" • ■ ■ be the outcome of C on u. 
For i > 1, let vi = Wi# ■ ■ ■ i^Wi be the prefix of v which ends with Wi. Let 
\vi\ denote the length of Uj, then = (i — 1) + X^il^il- The last # of the 
prefix Vi is located at \vi-i \ + 1 (for i > 1). Thus, CV , +1 = (^o)c which is the 
initial distribution of C. By construction, CV i h 1+ i ul .i(j'/) = P.4(u>i). Hence, 
||C^.||| > 1 - 2-' and lim^oollC^iH = 1. It implies that limsup JWOC ||C r l ;|| = 1. 
Hence v is a weakly synchronizing word for C, thus Cw(fi) 7^ 0. 

=>• Now let us assume that Cw(C) 7^ 0. So, by definition there exists an 
infinite word v = <7oO"ict 2 • • • such that limsup^^^HC^H = 1. We claim that 
v contains infinitely many Towards contradiction, assume that there exists 
neN such that for all i > n, <%; 7^ 

Let CqCi • • ■ be the outcome of C on v. There are two cases: 

— There exists j > n such that Gj = $. Since Postc(Qc$) = {qf, q n , q n } and 
Post c ({g f ,q n ,q n },£) = {q n ,q n }, we have C$ +l+i (q n ) = C] +1+i (q n ) = \ for 
all i £ N, a contradiction with the fact that v is weakly synchronizing. 

— For all j > n we have Uj 7^ $. Let fc be one position after the last # in w, or 

= if there is no #. For all i £ N, let 7^ = ak&k+i ■ ' • Cfc+i-i be the subword 
starting at k with length i; and let Cq'CJ'* • • -C ? Ui be the computation of C 
on the finite word v,. By Properties Pi and P 2 , C"'(q) = C?*(q) = Cl +l {q) = 
C v k +M) for all i e N and all q G Q \ {<?/} and C^ +i (g/) = 0. This gives 
< |, a contradiction. 

Now, we claim that v contains infinitely many $ too. Towards contradiction, 
assume that there exists n G N such that for all i > n, Ui 7^ $. Let fcofcifc 2 • ■ ■ be 
the sequence of all positions in v after n where a kj = | (j £ N) in increasing 
order (fcj+i > kj). So, fcj > n and (jj 7^ # for all j 6 PI and all i 7^ fcj. 
Let «i = (TkjO'kj+i ■ ■ ■ 0i be the finite subword of v between the positions kj 
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and i where kj < i < kj+i for some j G N. We see that Vi = #w for some 
w G Eg. Let Cq* • • -CJ^u. be the computation of C on By Properties P\ and 
P2, (%L kj (q) = C£ fcj (3) = Q(q) = C?(«) for alH > n and all g G Q \ {g/}, and 
also (qj) = 0. This gives ||Q'|| < h for all i > n, a contradiction with the fact 
that v is weakly synchronizing. 

We showed that v contains infinitely many # and $. Since v is weakly syn- 
chronizing, for all e > there exists m > where ||C^J| > 1 — e (In fact, since 
u is weakly synchronizing, for all e > for all n > there exists m > n where 
||C^J| > 1 — e, but we do not need n here). For fixed e < |, let m > be 
such that ||CJJJ| > 1 — e. Let k < m be one position after the last # before 
er m (i.e., tjfc_i = or fc = if there is no # before a m . Let w be the finite 
subword of v starting from position k to the position m. By Properties Pi and 
ft, C v m _ k (q) = C? n _ k (q) < i for all g G Q \ {<?/}. Therefore, since ||C« || > 1 - e, 
we have C^(g/) > 1 — e and Pa(w;) > 1 — e. Hence .4 has value 1. 
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